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Abstract — Due to increased radio spectral congestion, the 
trend in future cellular mobile radio systems is toward digital 
transmission. The recent advances in spectrally efficient mod- 
ulation techniques and high quality low bit rate speech coding 
have further aided this move. However, mobile radio channels 
are subject to signal fading and interference which causes sig- 
nificant transmission errors. The design of speech and channel 
coding for this application is therefore challenging. In this pa- 
per, the effects of digital transmission errors on a family of 
variable-rate embedded subband speech coders (SBC) have 
been analyzed in detail. It is shown that there is a difference in 
error sensitivity of four orders of magnitude between the most 
and the least sensitive bits of the speech coder. As a result, a 
family of rate-compatible punctured convolutional (RCPC) 
codes with flexible unequal error protection capabilities have 
been matched to the speech coder. These codes are optimally 
decoded with the Viterbi algorithm. On a Rayleigh fading 
channel with differential four phase shift keyed modulation, 
more than 5 dB gain in channel signal-to-noise ratio can be ob- 
tained by using 4 levels of unequal error protection over con- 
ventional designs that utilize only 2 levels. This gain is achieved 
over a large range of channel signal-to-noise ratios, at no extra 
bandwidth requirement and only a small complexity increase. 
Among the results, analysis and informal listening tests show 
that with a 4-level unequal error protection scheme, transmis- 
sion of 12 kb/s speech is possible with very little degradation 
in quality over a 16 kb/s channel with an average bit error rate 
of 2 • 10 2 at a vehicle speed of 60 mph and with interleaving 
over two 16 ms speech frames. The SBC speech encoder/de- 
coder and the RCPC channel coder/decoder have been imple- 
mented on a single AT&T DSP-32 floating point signal proces- 
sor. The overall end-to-end delay is about 88 ms. 


I. Introduction 

L OW and medium bit rate coders are currently being 
considered for deployment in future mobile radio sys- 
tems [1], [2]. The main motivations for these are the ef- 
ficient use of the radio spectrum and the ability to offer 
ISDN access facilities [3]. Advancements in high quality 
low bit rate speech coding algorithms with the associated 
ability to implement them on high speed digital signal 
processors [4] , and the development of spectrally efficient 
digital transmission methods have further aided this move. 
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Fig. 1. Block diagram of the communication system. 


Benefits of a digital technology include reliable encryp- 
tion for secure voice transmission. 

A block diagram of the system considered in this paper 
is shown in Fig. 1. The modulator considered is quater- 
nary phase shift keying (4-PSK) with differential encod- 
ing and differentially coherent detection (4-DPSK). This 
figure also shows the variability of the channel signal-to- 
noise ratio due to Rayleigh fading. We have also shown 
a typical worst case curve for the average bit error prob- 
ability versus the average signal-to-noise ratio for this 
Rayleigh fading channel [5] with 4-DPSK modulation. It 
can be seen that a major issue facing digitized speech 
transmission over a mobile radio channel is the impact of 
channel fading which results in error rates between 1 % 
and 5%. Left untreated, these high error rates result in a 
speech communication system that is of unacceptable 
quality. Hence, some form of highly efficient error con- 
trol coding is necessary to mitigate the effect of channel 
errors. 

The channel variation in a mobile environment depends 
on several factors, such as the position of the mobile in a 
coverage area, the speed of the mobile, etc. Depending 
on the local channel characteristics, one would like to 
change the allocation of the bits for speech and channel 
coding. On a good channel, fewer bits should be spent on 
channel coding than on a noisy channel so that the overall 
noise due to both quantization and the channel distortion 
is minimized. Hence there is a requirement for the speech 
coder to operate at several different bit rates. 
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In this work, we consider the design of a flexible and 
adaptive speech coding system for the mobile radio chan- 
nel. The speech coder is a dynamic bit allocation subband 
coder (D-SBC) which is capable of providing communi- 
cation quality speech at a lower end of 10 kb/s and high 
quality speech at a high rate of 16 kb/s [6]. A novel set 
of embedded nonlinear quantizers enables the same coder 
and decoder to operate at all these bit rates. 

The design of an error correction scheme usually con- 
sists of selecting a fixed channel code with a certain rate, 
complexity, and a correction capability that is uniform for 
all the data to be transmitted. Further, the fixed code is 
constructed for the worst case of average channel or source 
conditions. However, to make the best available use of 
the limited channel bandwidth, it is necessary to match 
the error protection provided by the channel code to the 
error sensitivity of the specific speech coder. For exam- 
ple, in our coder, we have noticed that error rates of the 
order of 1 % can be tolerated easily for the least significant 
bits of the bit stream. Much more stringent requirements 
are necessary for the more significant bits. Similar obser- 
vations have been made about other source coding sys- 
tems [7] -[10]. Clearly, it would be a waste of bits to pro- 
vide uniform error protection for the entire bit stream 
based only on the error sensitivity of the more significant 
bits. On the other hand, if the basis for error protection is 
the error sensitivity of the less significant bits, then the 
more sensitive ones will be exposed to an unacceptably 
high error rate. High quality speech coders are typically 
block processors and are made adaptive in order to exploit 
the perceptual properties of the human ear. The task of 
determining the relative importance of the bits in the bit 
stream and then constructing an error correcting code to 
match these measurements is quite challenging. 

A block channel coding scheme would seem natural for 
error protection since these sophisticated speech coding 
schemes also generate blocks of digitized speech. Un- 
equal error protection block codes have been studied in 
literature following the work of Masnick and Wolf [11]. 
However, these algebraic block coding schemes cannot 
easily accommodate broadly varying unequal error pro- 
tection needs within one code word. Different portions of 
the encoded speech frame can of cpurse be encoded and 
decoded with different block codes but this leads to either 
very short and inefficient codes or too long a delay. Fur- 
thermore, block codes are easily decodable only if the de- 
modulator output is a hard decision rather than a soft de- 
cision which leads to error performance degradation. To 
distinguish between hard and soft decisions, we observe 
that although the data to be transmitted is binary, the de- 
modulated signal takes on an analog value. This is due 
to signal fading and additive noise. When binary trans- 
mission and hard decision demodulation is employed, the 
output of the demodulator is quantized to either a logical 
zero or one. By contrast, the soft demodulator consists of 
more than two values, and the occupancy of a value gives 
us the reliability of the demodulated output being a logical 
zero or one. One of the simplest soft demodulators is a 


3-zone demodulator, in which two of the values are log- 
ical zero and one, and the third is an “erasure,” which is 
the output when it is considered to be sufficiently unreli- 
able to declare the demodulated value as logical one or 
zero. The best soft demodulator would deliver the re- 
ceived value in a floating point format. 

On a fading channel, the potential reduction in trans- 
mitted signal power is considerable when the decoder can 
use soft decisions rather than hard decisions [5] . Further 
improvement can be obtained if the time variation of the 
channel amplitude (channel state information, CSI) can 
be used in decoding. Hence, in this work, we propose the 
use of rate-compatible punctured convolutional (RCPC) 
codes [12], since they meet the requirements of handling 
soft decisions for decoding, as well as being capable of 
providing a flexible and wide range of unequal error pro- 
tection. The RCPC codes are easily decodable by a max- 
imum likelihood sequence estimator which can be effi- 
ciently implemented by the Viterbi algorithm [13]. The 
time variation of the channel amplitude can also be in- 
corporated easily into the Viterbi algorithm to enhance the 
reliability of decoding. This cannot be readily accom- 
plished with algebraic decoding techniques for block 
codes. Another significant advantage of the RCPC codes 
is that only one decoder is needed even if the level of error 
protection, and hence the code rate, changes several times 
within one speech frame. Although convolutional codes 
of this type are ideally suited to handle uncorrelated er- 
rors, errors which occur in bursts can be pseudorandom- 
ized through some form of interleaving (at the expense of 
added delay) . 

Combined source and channel coding schemes of the 
above type are evaluated in this paper through a mixture 
of analysis and simulations. In so doing we will make use 
of the developments and results on subband speech coding 
and convolutional coding from [6] and [12] and the error 
sensitivity analysis techniques in [7]— [10] . We have gen- 
eralized and refined these techniques so that the sensitiv- 
ity to transmission errors in individual bits in a block of 
speech can be calculated. Segmental signal-to-noise ratio 
is used to measure the objective quality of speech in the 
presence of both quantization and transmission noise. For 
tutorial texts on speech and channel coding we refer the 
reader to [14] and [13], respectively. The performance of 
RCPC codes in the narrow-band mobile radio channel that 
we are considering is presented in detail in the companion 
paper [5]. The details there include a complete description 
of the RCPC codes, the mobile radio channel model, and 
the theoretical and simulated bit error rate performance. 
We shall make use of these bit error rate results in eval- 
uating our combined speech and channel coding systems. 

For systems with high performance speech coders and 
advanced channel coding it is very time consuming to per- 
form computer simulations for a wide variety of signal 
design parameters and channel conditions. For the pur- 
pose of simplifying the task of performance evaluation of 
such systems, we present a general method of calculating 
the segmental speech signal-to-noise ratio. The formula 
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takes as inputs a set of error sensitivity parameters, which 
are calculated once for a particular speech coder. Another 
set of input parameters are the individual bit error prob- 
ability values. These can be calculated for simple trans- 
mission systems, but in practice they are simulated for a 
particular channel, channel coder, and modulation sys- 
tem. With our approach we have in effect split the overall 
system simulations in component source and channel sim- 
ulations with a huge saving in computer time as a result. 
This cannot be done without approximations. Thus, our 
method should be used for initial screening, comparison 
and rough optimization of, e.g., coding and modulation 
designs. 

In Section II, we present a general method to analyze 
the effect of transmission errors on a speech coding sys- 
tem. Based on this analysis, the error sensitivity of the 
bitstream is obtained. In Section III, the optimum error 
protection levels are synthesized from the bit error sen- 
sitivity results so that a required segmental SNR is ob- 
tained at the receiver. In Section IV , we describe the sub- 
band coder used in this work, and the bit error sensitivity 
results are obtained for this specific coder in Section V. 
Section VI briefly describes the rate compatible punctured 
codes, the channel model, the optimal decoding algo- 
rithm, and summarizes the design methodology of the 
combined speech and channel coding system. Section VII 
describes the DSP implementation and Section VIII has 
performance evaluations of various systems including de- 
lay considerations. Section IX concludes our work with 
discussions. 

II. Effect of Transmission Errors on the Speech 
Coder Using Segmental SNR 

The goal of this section is to derive an objective mea- 
sure of the error sensitivity of the digitized speech. This 
is done by injecting errors in each bit position of the dig- 
itized speech bit stream, and measuring the distortion due 
to that error. This is done in every frame, and the average 
distortion is defined on a segmental basis. The analysis 
generalizes those of [7] -[9] on pulse code modulation 
(PCM), and those of [7], [10] on differential PCM 
(DPCM) . Our methodology is general enough to encom- 
pass a wide range of coders, and the analysis can be mod- 
ified to suit different criteria. 

A. Error Sensitivity Analysis 

Let x (f) be the speech waveform which is divided into 
J nonoverlapping segments of duration T B seconds and 
then encoded into N bits. Let q(t ) be the reconstruction 
of the speech waveform at the decoder when there are no 
transmission errors. The encoding procedure is blockwise 
memoryless and the effect of a transmission error is mostly 
confined to that frame alone. We ignore the processing 
and transmission delays in these mathematical represen- 
tations. In a real system, a delayed version of x{t) should 
be compared to q(t) so that the same part of the signals 
x(t) and q(t) are compared. The V-bit packet is then en- 
coded by the channel coder into N + N R bits, modulated, 


and transmitted over the channel. At the receiver, the sig- 
nal is demodulated and decoded into one of the 2 N possi- 
ble binary information sequences. The modulo 2 differ- 
ence between the actual and the decoded sequence is the 
error sequence. Let e be an integer representation of an 
error pattern (there are 2 N error patterns) with the single 
bit errors numbered 1 through N followed by two bit er- 
rors, etc. Let q e (t) be the reconstructed version of *(f) 
when the error pattern e occurs across the V-bit packet. 
The number of such error patterns is 2 N and e = 0 cor- 
responds to correct transmission. The speech signal power 
in block j is 

p u) = t r [ X (t )f dt CD 

and the expected value of the noise power is 

' jT B V 

; [x{t) - q e {t)f dt[ (2) 

'o-DTb J 

where the expectation is taken over all possible channel 
error patterns with the probability of the occurrence of the 
error pattern e being P e . Then the signal-to-noise ratio for 
block j is p (J) /n ij) and the long-term segmental signal-to- 
noise ratio in decibels can be obtained as 

1 J 

SEGSNR = - 2 10 log (p u) /n u) ) (3) 

J j = 1 

where the logarithm here and henceforth is in base 10. 
We will study (3) more closely to determine the parame- 
ters that need to be calculated from the speech samples in 
order to evaluate the performance of the speech coder in 
the presence of transmission errors. It follows from (2) 
that for a certain error pattern e , the noise contribution 
can be rewritten as 
JTb 

[x(t) - q e (t)] 2 dt 

(j - DTb 

jTB 

[a\t) + b 2 (t) + c(r)] dt (4) 

O-i )Tb 

where 

a(t) = x(t) - q(t) 

bit) = q{t) ~ q e (t ) 
and 

c{t) = 2[x(t) - q(t)][q(t) - q e (t)]. 

Here, a(t) represents the quantization noise, b{t) repre- 
sents the contribution solely due to channel errors, and 
c(t) is a mutual error term. For the systems considered in 
[7]— [9], this mutual term is approximately zero and thus 
neglected. For quantizers with few bits per sample, we 
found in [10] that it should be included. The second and 
the third terms in the right-hand side of (4) are zero if 
there are no transmission errors. The expected value of 
the total noise power assuming independence of error pat- 
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terns across frames is then 
1 ( JTb 

n (j) = — \ a\t ) dt 

2"- i r, wT S -) 

+ 2 PA-\ { b\t ) + c(f)} dt{ (5) 

e=\ - 1)7» ) 

where P e is the probability that channel error pattern e 
occurs. The signal-to-noise ratio for block j can then be 
conveniently rewritten as 


where 


p u)/ n u) = ]j | 'qu ) + s p e a ( e j) 


Q U) = 


pJTb 

J ( / - 1 


(j-\)T B 


[x(t) - q(t)] 2 dt 


J jTB 

MO ] 2 dt 

0-1)7* 


( 6 ) 


(7) 


is the quantization noise normalized with the speech sig- 
nal power, and 


a l e J) = 


v/7* 

'O' - 'IT* 


{[b(t)] 2 + c(0} dt 


J jTB 
0-1)7* 


[xun 2 dt 


( 8 ) 


is defined as the (2-factor corresponding to block j and 
error pattern e. This (2-factor is a short-term objective 
measure of the effect of a particular error pattern [8] . 


B. Approximations 

Equation (6) requires the calculations of 2 N parameters 
(2 N — 1 (2-factors and quantization noise) for each seg- 
ment of speech and since N is typically over 100 b there 
will be computational problems. However, simplifica- 
tions can be made under the assumption that the error pro- 
tection by the channel code is strong enough that the most 
likely error event is that of a single bit error affecting a 
given frame. Hence, with independent single bit errors, 
we have 

2 N - 1 N 

2 p e ai J) * 2 p,aP (9) 

e = 1 i - 1 

where P { is the bit error probability in position i and where 
(2, is the (2-factor associated with that bit error. It is as- 
sumed that the first N error patterns correspond to single 
bit errors. Appendix A provides a more detailed treatment 
which includes the effect of double error patterns. There, 
we will also justify the single error approximation even 
for high values of the bit error probability for independent 
bit errors. Thus for unequal error protection, the segmen- 


tal SNR can be approximated as 


l J 

SEGSNR = - 2 10 log 
J j = i 


Q { 


iO) 


+ 2 p,a\ J] 

i= 1 


( 10 ) 


From the above expression, we note that by calculating 
(N + 1) parameters (N (2-factors and quantization noise) 
for each speech block, the segmental SNR can be evalu- 
ated for any set of bit error probabilities P h i = 1, 
* • • , N. 

From (10), we obtain the long-term comparisons of the 
sensitivity to single errors in different bits by setting the 
quantization noise Q (j) to zero and by injecting an error 
event with P { = 1 for bit i and P, = 0 for j =£ i. For this 
bit i, we define the average normalized noise power caused 
by an error in position i as 

1 3 

-2 10 log ap. (ii) 

J j= » 


This value is thus a single parameter objective measure of 
the average error sensitivity of a particular bit. 


III. Synthesis of Error Protection Levels From 
Error Sensitivity Measurements 

Our ultimate design goal is to provide the highest qual- 
ity speech communication system that is possible for the 
given set of channel conditions (at a practical complexity 
level). If the quality that is already obtained at the re- 
ceiver without channel coding is considered sufficient then 
there is no need for additional error protection. However, 
in a situation such as ours, the channel error rate is high 
enough that the quality of speech at the receiver is clearly 
unacceptable. Moreover, the channel bandwidth is also 
severely limited, and hence the problem would be to find 
the highest speech quality that is achievable given these 
constraints. This requires that the error protection pro- 
vided be matched to the bit error sensitivity requirements 
so that those bits which are the most sensitive to channel 
errors get the most protection. 

To find the necessary unequal error protection that is 
needed, we will use the intuitive rule that all the speech 
bits after error protection should contribute the same to 
the average overall noise caused by the transmission er- 
rors. It is not practical to use 100’s of levels of error pro- 
tection since the task of channel code design would be 
impractical. Many of these bits may have the same or sim- 
ilar error sensitivities. We will therefore cluster those bits 
with similar (2-factors and use the same error protection 
levels for all these bits. To guide us in the design; we 
define the block (2-factor for cluster k during segment j as 

1 Nk 

q [ j) = — 2 etp. d2) 

N *1 = 1 

We require each cluster, after error protection, to contrib- 
ute the same noise on an average as any other cluster. 
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This equal impact of errors is achieved by letting the error 
protection profile {P* } be such that 

j 

i i i 

= D = constant, Vfc. (13) 


1 

- X 10 log 
J 7 = 1 


A ai n 


This is equivalent to 


Pk 


j 

n a{ j) 

j = 1 


/J 

= D, 


10-°/'°, V*. (14) 


The quantity D ] can be determined by setting an ex- 
plicit limit on the noise contribution due to transmission 
errors. For example, we can impose the rule that the op- 
timum profile should satisfy (14), and that the segmental 
transmission noise power equal the segmental quantiza- 
tion noise power (a fair criterion for allocation of the 
available bits between the speech and channel coder). 
Then, we get 


1 

- X 10 log 
J j = \ 


1 


K 

S p k N k a{ j) 

*=i * * 


1 

= - X 10 log 
J j= 1 



(15) 


Here P k is the probability of a bit being in error in group 
k. This yields the following closed form expression forDj 
in decibels: 


10 v, 

D, (dB) = - S 
J j= i 


K 

log Q U) - log X 

k = 1 



(16) 


However, one may not be able to use this criterion in real- 
ity, because the speech coder would be required to have 
a certain subjective quality under noiseless conditions, and 
this would necessitate allocating a fixed portion of the to- 
tal bit rate for speech coding. In practice, the error prob- 
abilities /y s of the channel coder can be simulated for the 
given channel coding rate. The values of d k can also be 
measured for the speech codes. Finally, we seek that pro- 
file P k for which the average impact of errors in every 
cluster is low and are approximately equal to each other. 


IV. Subband Speech Coder 
Subband coding of speech is a relatively mature form 
of waveform coding of speech. The speech signal is first 
divided into a number of subbands, which are then indi- 
vidually encoded. The underlying principle for the coder 
is that the bit allocation can be weighted so that those 
subbands with the most important information get most of 
the bits. The initial subband coders used fixed bit alloca- 


tions based on the average spectrum of speech. Typical 
of this generation of coders was the one by Crochiere et 
al. [15]. In 1982,, Ramstad introduced the idea of dynam- 
ically changing the bit allocation [16] based on the energy 
of each subband. Here, the bands with the most energy 
get most of the bits. More recently, Honda and Itakura 
[17], and Soong et al. [18] proposed dynamically assign- 
ing bits in both time and frequency. Their work produces 
very high quality speech. The complexity of these algo- 
rithms is very high, however. 

In this work, we have considered a coder based on the 
idea proposed by Ramstad. A block diagram of the trans- 
mitter portion of this coder is shown in Fig. 2. The speech 
is divided into six 500-Hz-wide subbands and into 16-ms 
frames using GQMF filterbanks [19], [20]. Each of the 
subbands produces 16 samples per frame. Thus there are 
a total of 96 samples to quantize and they constitute the 
main information. Five bits are used to quantize the en- 
ergy of the samples in each subband, thus totaling 30 b 
of side information. In addition, 2 b are allocated to the 
side information for the purpose of synchronization and / 
or signaling. Thus, the number of side information bits 
per 16-ms frame is 32 and they use up 2 kb/s of the total 
bit rate. The quantizer reconstruction levels are propor- 
tional to the square root of the energies, which gives us 
an estimate of the standard deviation for each of the bands. 
This estimate is available at both the transmitter and the 
receiver and is the basis for the quantization of the sub- 
band signals. Quantization is essentially logarithmic over 
a 72-dB range. 

Bit allocation is derived from the quantized energies 
using an iterative procedure. At each iteration, 16 b (1 b 
per subband sample) are allocated to one of the subbands. 
Each iteration consists of finding the subband with the 
largest rms value, halving this value, storing the result in 
an rms table, and allocating 16 b to that subband. There 
is one additional proviso— no frequency band can be al- 
located more than 4 or 5 b per sample, depending on the 
maximum bit rate of the coder. Each iteration represents 
1 kb/s of information. A nonuniform embedded quan- 
tizer optimized for a Gaussian input is used to quantize 
the individual subband samples. The step sizes of this 
quantizer are adjusted according to the quantized rms 
value of the subband. The principle behind the construc- 
tion of the nonuniform quantizer is given in [6] and we 
will not go into the details. Embedded coding along with 
the concept of a prioritized bit stream enables the same 
coder and the decoder to operate at different rates in in- 
crements of 1 kb/s. 

The key feature of our coder is the prioritized bit 
stream. This feature permits the rate of the coder to be 
changed in steps of 1 kb/s simply by “snipping” off the 
appropriate number of 16 b packets appearing in the end 
of a frame. Because of the embedded nature of the quan- 
tizer, the samples can be reconstructed at the decoder. In 
the mobile radio context this permits the appropriate di- 
vision of the total bit rate that is available between the 
speech and the channel coder. 
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224 BITS/ 



Fig. 2. Dynamic bit allocation subband coder. 

FIRST 16 BITS ARE SIGN BITS FOR BAND 1 SAMPLES 

| • SECOND 16 BITS ARE SIGN BITS FOR BAND 2 SAMPLES 

| • THIRD 16 BITS ARE 1ST MAGNITUDE BITS FOR BAND 1 SAMPLES 

[-• FOURTH 16 BITS ARE SIGN BITS FOR BAND 3 SAMPLES 
ETC. 


EACH SMALL BLOCK REPRESENTS 16 BITS 


I 1 | 1 | 2 1 3 | 4 | 5 | 6 | 7 | 8 | 9 1 10 | 11 1 12 | 13 | 14 | 

SIDE QUANTIZED SUB-BAND SAMPLES 

INFORMATION 224 BITS 

32 BITS 

Fig. 3. Example of frame organization for 16 kb/s subband coder. 

Perhaps the most important benefit of the prioritized bit 
stream for error protection comes from the fact that the 
average bit error sensitivity of the main information bits 
in a digitized speech packet decreases monotonically as 
we move from the beginning of the packet to the end thus 
lending themselves to unequal error protection. We will 
show that prioritization makes the relative importance of 
these bits almost invariant to input nonstationarity. This 
pseudostationarity of the error sensitivity is extremely 
crucial in designing the error protection since it places 
less stringent requirements on the channel code. A non- 
stationary bit error sensitivity profile would require us to 
change the channel coding adaptively, thus rendering the 
task of error protection more difficult. In particular, we 
have noted that the main information bit error sensitivity 
is invariant to changes in the input power level fluctua- 
tions. 

Fig. 3 shows how the bit stream prioritization can be 
accomplished by considering a digitized speech packet for 
the 16 kb/s coder during a frame of 16 ms. There are 256 
b to be allocated and they can be thought of as 16 b words. 
In this example, the order of bit allocation is subband 1, 
subband 2, subband 1, etc. The bit stream is also arranged 
in the same order. At the beginning of the stream are two 
16 b words allocated for side information. The third 16 b 
word is allocated to subband 1 and they are the sign bits 
of the quantized samples for that band. The fourth 16 b 
word is allocated to subband 2 and they are the sign bits 
for subband 2 quantized samples. The fifth 16 b word is 
for the subband 1 samples and they correspond to the most 
significant magnitude bits for the samples of subband 1 . 

At the receiver, the side information is decoded first. 
Based on the side information, and with the knowledge of 
the rate of the coder, the bit allocation can be determined. 
For variable rate coding, the rate of the code can be trans- 


mitted as additional side information. From this knowl- 
edge, the remaining bits can be decoded to reconstruct the 
96 subband samples. The synthesis of these subband sam- 
ples with the synthesis filter bank yields the speech out- 
put. 

V. Error Sensitivity Analysis for the Subband 
Speech Coder 

A. Effect of Single Errors on the Speech Coder 

Here, we use the theoretical developments in Section II 
to evaluate the average error sensitivity of the bits from 
the subband coder. From this error sensitivity profile, we 
determine the tolerable values of error probability on these 
bits. To determine the average relative importance of a 
bit output from the coder, an error is introduced into that 
bit alone in every frame and the resulting segmental SNR 
is determined. Comparison of the segmental SNR’s of the 
bits with error determines their importance. In our work, 
about one thousand 16-ms frames of male and female 
speech were considered in the averaging process. How- 
ever, for the numerical results in this paper, we use the 
following 2 sentences corresponding to a total of 256 
frames. The sentences are as follows. 

Male: “Her father failed many tests.” 

Female: “An icy wind raked the beach.” 

The speech was band limited between 100 and 3000 
Hz, and sampled at 8 kHz to give the speech samples for 
our simulations. The speech samples are processed by the 
analysis and synthesis filters of the subband coder before 
evaluating the speech power in a segment. To obtain the 
quantized samples of speech, the speech samples are ana- 
lyzed and encoded into a binary stream. At the decoder 
the bits are reconstructed into the appropriate subband 
samples, and then synthesized. The difference between 
the latter and the former speech samples gives the quan- 
tization noise alone. To evaluate the effect of channel er- 
rors, single errors are added modulo 2 to the binary bit 
stream representing the coder output. The binary se- 
quence with error is then reconstructed into subband sam- 
ples, and then synthesized to give the speech that is dis- 
torted by the subband coding process and by the channel 
errors. 

Fig. 4 shows the result of these calculations for the 12 
kb/s speech coder. The horizontal axis represents the in- 
formation bits at the speech encoder output. The vertical 
axis represents the decoded speech segmental SNR. The 
first 30 b represent the side information. The results are 
arranged by bands and then the order of bits for each sub- 
band. The left-most bit (number 3) represents the most 
significant bit for subband 1 . Bit number 32 represents the 
least significant bit for subband 6. It can be seen that the 
two most significant bits of each band have the most im- 
pact on performance. When this experiment was repeated 
for other rates, only the absolute value of the segmental 
SNR for each bit differed and the relative importance re- 
mained the same. Perhaps the most significant result is 
that there is about 23 dB degradation caused by an error 
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SIDE INFORMATION 


Fig. 4. Bit error sensitivity of the 12 kb/s coder. Single errors in bits 3 to 
192. 



INFORMATION 


- MAIN INFORMATION - 


BIT NUMBER i 


Fig. 5. Error sensitivity for the bits of the 12 kb/s coder calculated ac- 
cording to (1 1). 


in the most significant bit of the side information when 
compared to the quantization noise limited performance 
which corresponds to about 14.2 dB. Another significant 
result is that there is more than 20 dB variation in error 
sensitivity even among the side information bits. This 
shows that some of the less significant side information 
bits are rather insensitive to channel errors. Fig. 4 also 
shows the result of the calculation performed for the main 
information bits. It can be seen that the first 16 b (numbers 
33 to 48) are more sensitive to channel errors than the next 
16 b, etc. The effect of errors on the least significant bits 
is almost negligible. Thus the subband coder main infor- 
mation output is inherently prioritized. However, it can 
be seen that some of the significant main information bits 
are more sensitive to channel errors than some bits of the 
side information. Thus, better prioritization can be ob- 
tained by rearranging some of the side information and 
main information bits. This would further facilitate un- 
equal error protection. 

In the subband coder we have used scalar quantizers 
with a sign bit code representation (first bit is a sign bit, 
next bit is the most significant magnitude bit, etc.). We 
also investigated the improvement in error sensitivity by 
using a better (more robust) bit representation (index as- 
signment) for the quantizer output levels. For scalar quan- 
tizers we used the minimum distance code (MDC) repre- 
sentation [8] which is significantly more robust to 
transmission errors in PCM than the conventional sign bit 
code. For transmission without channel coding, espe- 
cially for low level samples, there are significant im- 
provements. However, with powerful channel coding for 
very noisy channels, the overall system performance dif- 
ference using various bit representations (MDC or others) 
is minor. 

B. Error Sensitivity 

It can be seen from Fig. 4 that when an error occurs in 
the less significant bits, the noise due to channel errors is 
masked by the quantization noise. Hence, to obtain a 
clearer picture of how the errors in different bits contrib- 
ute to the noise, we have calculated the error sensitivity 
without quantization noise as given by (11). We have ob- 
served that in some blocks /, and for certain bits i, (t\ j) 
can be negative. This implies that inverting that bit ac- 


tually decreases the total noise contribution for that block. 
This effect is mainly evident on the least significant bits 
of main information. Hence, we include only those seg- 
ments contributing nonnegative single error & (j) values. 
The long-term effect of this is plotted in Fig. 5 for the 12 
kb/s speech coder on a decibel scale. Note that the vari- 
ation of the noise level between the most and the least 
significant bits is more than 40 dB. Also note that for error 
free transmission, the normalized quantization noise is 
about —14.2 dB. The effect of transmission single errors 
on the least important bits are of little or no importance, 
since their individual sensitivity to errors is very low. 
However, if many of these less significant bits are in er- 
ror, then their total noise contribution becomes signifi- 
cant. Thus omitting less significant bits or transmitting 
them with high error probability will soon have an impact 
on speech quality. The effect of double errors is discussed 
in Appendix A. 

C. Segmental SNR with Ideal Error Protection 

Fig. 6 illustrates the effect of the unprotected bits in a 
speech block on the overall segmental signal-to-noise ra- 
tio corresponding to the channel conditions of Fig. 1. The 
vertical axis shows the output segmental SNR. The hori- 
zontal axis is the average channel SNR per transmitted bit 
on a mobile radio channel [5] . The number of most sig- 
nificant 16 b subpackets that are perfectly protected is 
shown beside each curve. The segmental SNR is calcu- 
lated using (10). The results show that for channel SNR’s 
above 15 dB (bit error rate between 1 % and 3%), at least 
the four most significant 16 b subpackets should be pro- 
tected well. Otherwise the overall performance will be 
considerably degraded. These results serve as an upper 
bound to the speech quality that can be achieved using 
actual channel codes. Further, they also reveal how many 
bits can be left unprotected, and still have good quality 
speech. 

VI. Channel Error Protection 
A. Rate Compatible Punctured Codes 

From earlier sections, we have seen that the bit stream 
from the speech encoder output exhibits widely varying 
error sensitivity within each speech frame. Hence, there 
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Fig, 6. Speech SEGSNR versus channel SNR for ideally protected 16 b 
subpackets. 


is a need to build error correction codes that match this 
widely varying error sensitivity. Let us assume that there 
are K groups of bits, with the bits in group k requiring a 
final bit error rate of P k . One could separately encode each 
of the K groups with K different encoders and decode with 
K different decoders. This has indeed been done by Suda 
and Miki [21] for error protection of backward adapted 
predictive speech coders. However, this configuration re- 
sults in increased decoding complexity due to the use of 
different decoders. Further, short block codes are inher- 
ently inferior and very low channel code rates are needed 
to get the necessary error protection. This results in in- 
creased overhead. Here, we wish to use one single chan- 
nel coder with a single maximum likelihood decoder 
which provides the error protection requirements within 
one speech frame with minimal amount of redundancy. 
This can be achieved when the concept of punctured con- 
volutional codes [22] is modified by introducing a rate 
compatible restriction to the puncturing rule [12]. 

In order to briefly explain rate compatible punctured 
convolutional codes (RCPC), we start with the example 
of Fig. 7 where a rate R — 1/2 convolutional code with 
memory M = 2 is shown. The input to the convolutional 
encoder at any time j takes on values ± 1 . The outputs of 
the encoder x Xj and x 2j also take the same values. These 
output symbols are punctured periodically with period p 
= 4 according to the puncturing rules a (1) or a (2) which 
are shown in the figure. A zero in the puncturing table 
means that the code symbol is not to be transmitted. Thus, 
if a(\) were used for puncturing, the outputs after punc- 
turing would correspond to those in Fig. 7. At time j = 
1, both the output bits are transmitted. At times ; = 2, 3, 
and 4 only x l2 , x 13 , and x 24 are transmitted. The punctur- 
ing rule is then repeated periodically. Thus, we have re- 
alized a rate R — 4/5 code by puncturing the lower rate 


PUNCTURING 



TABLE 

Fig. 7. Example of two RCPC codes with memory M = 2, puncturing 
period p = 4. Mother code rate R — 1/2. Punctured code rates are R = 
4/5 and/? =4/6. 



Fig. 8. Bit error rate for a RCPC code over the Gaussian channel with 4 
different code rates. Memory M = 3, puncturing period p = 4. Gaussian 
channel and binary PSK with hard decisions. 


R = 1/2 mother code. The puncturing table can be de- 
scribed byaniVxp = 2x4 matrix: 


a( 1 ) - 


"1110 
10 0 1 _* 


(17) 


To realize a rate R = 2/3 code which has a rate lower 
than R = 4/5 but higher than R — 1/2, one could use 
any puncturing rule that deletes the appropriate number of 
bits from the # = 1 /2 mother code. However, if this code 
has to be compatible with the higher rate R = 4/5 code, 
it should also transmit the same bits as those transmitted 
by the R = 4/5 code. Thus, l’s in the a(l) puncturing 
matrix corresponding to R = 4/5 code cannot be changed 
to 0. In order to meet the rate compatibility requirement, 
we can use the puncturing table 


ri 

a (2) = 


1 1 0 " 

1 0 1 _ 


(18) 


In general, from a mother code of rate R = 1 / A, we 
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Fig. 9. Decoder trellis for the R = 4/5 RCPC code of Fig. 7. 


can obtain a family of codes with rates 

R = -~ v / = 1, • • • , (N - l)p (19) 

where p is the puncturing period. 

The reason for rate compatibility is explained in detail 
in [5], [12]. However, a brief explanation can be given 
with the aid of Fig. 8. Here, the simulated bit error prob- 
ability performance of these codes are shown on a Gauss- 
ian channel with ideal coherent binary phase shift keying. 
In a transitional phase, as we go from a high rate code 
(example 4/5) to a low rate code (example 4/6), we have 
to guarantee that the error performance in the transition 
region does not degrade due to the influence of one code 
over the other. This is usually done in practice by termi- 
nating the code memory for each rate by using known tail 
bits. However, this results in a waste of redundancy. Al- 
ternatively, one could satisfy the rate compatibility con- 
dition to ensure that the transitional performance is at least 
as good as the performance of the high rate code, and 
typically much better. In the example, we note that the 
bit error probability of the high rate code near the transi- 
tion region is better than its nominal performance (which 
is in the middle). This is due to the influence of the lower 
rate code which overall has a lower error probability. On 
the other hand, the performance of the lower rate code at 
the transition region suffers slightly due to the influence 
of the higher rate code. 


likelihood sequence metric which is given by 

j 

max 2 X, m (20) 

m 7—1 

where \JP is the metric increment for path m in the trellis 
at time j. The maximum is evaluated over all 2 3 possible 
paths, where J is the trellis depth. The metric increment 
is typically 

N 

x; = 2 a^yij (21) 

where af s are the elements of the puncturing matrix, x™ 
is the trellis symbol (± 1) on branch j at bit number i for 
the path m. The yfs are the received values either in the 
form of hard or soft decisions, and ranging from binary 
to floating point representations. During a fade, the re- 
ceived values are less reliable than during a nonfading 
situation. Thus if the fade information (channel state in- 
formation (CSI), i.e., the estimated channel amplitude) is 
available at the receiver, it can be easily incorporated into 
the Viterbi algorithm. Let be the CSI for the received 
symbol y t j. The metric increment is given by 

N 

x; = 2 a^jxTjytj. (22) 

/ = 1 

The CSI is readily available at the receiver AGC. Incor- 
porating the CSI improves the decoder performance [5] . 


B . The Viterbi Decoding Algorithm for Fading 
Channels 

Optimal decoding of the transmitted signals in fading 
and noise can be efficiently performed by the Viterbi al- 
gorithm. Basically, the Viterbi algorithm (VA) for the 
memory M — 2 channel code in Fig. 7 operates on the 
trellis in Fig. 9. The rate of the code after puncturing is 
R - 4/5. The VA efficiently calculates the maximum 


C. Channel Model for Mobile Radio 

The details of the channel simulation model are ex- 
plained in detail in [5]. Only the essentials are presented 
here. Differentially encoded and detected 4-PSK 
(4-DPSK) is chosen as the modulation format. The chan- 
nel imposes correlative Rayleigh fading on the transmit- 
ted 4-DPSK symbol (each symbol is 2 b). The correlation 
in the fades is generated by coloring a white noise se- 



1726 


IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 39, NO. 8, AUGUST 1991 


quence with a finite impulse response (FIR) filter whose 
cutoff frequency is controlled by the carrier frequency, 
the symbol transmission rate and the vehicle speed. 
Slower vehicle speeds result in longer fades. This fact, 
combined with limited interleaving results in higher resid- 
ual error rates after Viterbi decoding than if the vehicle 
speed were higher. All of our following results are given 
for 60 mph vehicle speed because the fades are very long 
at slower vehicle speeds, resulting in excessively long 
times for simulations. 

D. Summary of the Code Design Methodology 

The flowchart of Fig. 10 summarizes our design effort 
for the combined speech and channel coding system. The 
speech coder is first analyzed for its sensitivity to channel 
errors. This requires the evaluation of the d factors as 
described in Section II. We then fix the output SNR under 
noisy channel conditions to be at a certain value below 
the clear channel speech quality (for example, 3 dB below 
the clear channel quality). This, combined with the error 
sensitivity analysis gives us the bit error probability pro- 
file that is needed, and the procedure to calculate the pro- 
file is presented in Section III. For a fixed set of channel 
conditions (type of fading, modulation, and interleaving 
(delay considerations)) and decoding complexity (code 
memory, soft or hard decisions, availability of CSI, etc.), 
we seek the lowest possible average channel SNR at which 
the system can operate to give the required output speech 
quality . This step requires an extensive knowledge of the 
channel code performance for various code rates, and this 
can be done for simple channels by analysis and for more 
difficult channels such as ours by simulations. An addi- 
tional constraint we have is the total bit rate. If the redun- 
dancy required to meet the error protection requirements 
exceed the allocated bits for this purpose, then we need 
to either relax the output SNR requirements or increase 
the decoding complexity. Increasing the overall delay also 
helps in the form of larger interleavers which result in a 
better randomization of channel burstiness. It should be 
emphasized that the optimum error protection scheme 
varies with the channel SNR when everything else is kept 
unchanged. 

E. Codes for 12 kb/s D-SBC Protection 

We have designed two RCPC codes for the protection 
of the prioritized bitstream. The code itself has a memory 
M of 4. The puncturing period p is 8. Thus in the imple- 
mentation of the Viterbi decoder, we have to calculate 4 
incremental metrics, update the total metric into each of 
the 16 states, and update the path information. 

The first code is designed for a “clean” channel with 
the uncoded channel bit error rate being 2 % . The average 
channel SNR per bit ( E c /N 0 ) is about 17.5 dB. We have 
four error protection levels, where every 16 ms, the most 
important 16 bits are coded with the rate R = 1/2 mother 
code. The next 48 b are coded with the rate R = 2/3 
code. The next 64 b are coded with the rate R = 8/11 
code and the last 64 are left unprotected. This results in 
adding 16, 24, 24, and 0 b of redundancy to the 4 levels, 
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Fig. 10. Joint code design methodology. 


respectively, giving an overall rate of 256 b every 16 ms 
or 16 kb/s. In order to facilitate interleaving, two frames 
of speech bits are combined at a time. Further, we also 
note that there are 2 b per frame that are not used in speech 
coding. These 4 b per two frames can be used for termi- 
nating the memory of the convolutional code by trans- 
mitting a known 4-b pattern. Although the convolutional 
code is suitable for transmitting a continuous stream of 
bits, by terminating the memory, we have realized a 
“framed convolutional code.” In this example, the Vi- 
terbi decoder uses hard decisions on the received sym- 
bols. Soft values of the channel state information are used 
in the decoding process. The detailed simulation results 
presented in [5] are summarized here in Table I. 

The second code is designed for even noisier channels 
with the channel bit error rate being in the order of 4 % to 
6% ( E c /N 0 is about 12-9 dB). Here, the most important 
16 b are protected by a rate R = 1/2 code, the next 32 b 
with rate R — 4/7 code, the next 48 b with rate R = 2/3 
code, and the last 96 b are left unprotected. This results 
in a total bit rate of 16 kb/s. It also turns out that this 
design is ideally suited for implementing both the D-SBC 
coder (full duplex) and the channel encoder and decoder 
into one single AT&T DSP-32 processor. In this exam- 
ple, the Viterbi decoder uses only the soft decisions on 
the received symbols. The channel state information is 
not used. The performance of this code is presented in 
Table II. In general, it is advantageous to use soft deci- 
sion decoding. In addition, if CSI is also available, it 
fetches additional benefit. 

VII. Implementation 

Both the D-SBC speech coder and the RCPC channel 
coder were implemented full-duplex on a single AT&T 
DSP32 signal processor. The DSP32 is a floating point 
signal processor which comes in both 40 and 100 pin 
packages. The 40 pin package cannot address off-chip 
memory. The 100 pin package DSP32 was used because 
the two programs combined exceeded both the 4-kilobytes 
RAM and 2-kilobytes ROM limitations of the 40 pin 
package. Also, the newer 25 MHz DSP32 had to be used 
to provide sufficient processing capability for both algo- 
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TABLE I 

Bit-Error-Rate Performance of First RCPC Code Design on 
Correlated Rayleigh Fading Channel with 4-DPSK Modulation 


Channel SNR 17 dB 15 dB 12 dB 


Unprotected bits (64) 2.00 X 10 2 2.80 X 10 2 

Rate 8/11 code (64) 2.00 x 10“ 3 4.5 x 1(T 3 

Rate 2/3 code (48) 3.00 x 10 -4 1.00 x 10 3 

Rate 1/2 code (16) 1.5 X 10“ 5 6.00 x 10~ 5 


3.89 x 10~ 2 
1.70 x 10~ 2 

6.00 x 10” 3 

4.0 x 10“ 4 


Vehicle speed = 60 mph, carrier frequency = 900 MHz. Simulation 
over 5000, 16 ms frames. Two frame interleaving. Hard decision de- 
modulation and full soft channel state information in Viterbi decoding. The 
number of bits protected by each code is indicated in parentheses. 


Input 

Speech 


Output 

Speech 



Implemented on 1 DSP-32 


to 16 kbls 
Channel 


from 16 kbfs 
Channel 


TABLE II 

Bit-Error-Rate Performance of Second RCPC Code Design on 
Correlated Rayleigh Fading Channel with 4-DPSK Modulation 

Channel SNR 17 dB 12 dB 9 dB 

Unprotected bits (96) 2.00 X 10" 2 3.89 x 10~ 2 6.35 X 10“ 2 

Rate 2/3 code (48) 3.00 x 10“ 5 2.60 x 10“ 3 2.03 x 10" 2 

Rate 4/7 code (32) 2.00 X 10“ 5 6.00 X 10“ 4 6.50 X 10“ 3 

Rate 1/2 code (16) 0.0 7.00 x 10“ 5 1.30 x 10“ 3 


Vehicle speed = 60 mph, carrier frequency = 900 MHz. Simulation 
over 1000, 16 ms speech frames. Two frame interleaving. Soft decision 
demodulation and no channel state information in Viterbi decoding. The 
number of bits protected by each code is indicated in parentheses. 


rithms, although either one alone could have fit on the 
older 16-MHz DSP-32. Approximately 53% of the real- 
time cycles were devoted to the speech coder and the re- 
mainder to the channel coder. The largest number of 
cycles were used in the Viterbi decoder. This algorithm 
required the simultaneous update of 16 states in the trellis 
as well as keeping track of the optimal path through each 
of the 16 states. 

Fig. 11 is a block diagram of how the combined coders 
were implemented. At the transmitter the speech data from 
the codec A/D is first processed by the D-SBC encoder. 
The bitstream from this coder is then input to the RCPC 
encoder. The output bitstream from the RCPC encoder is 
then ready for the modulation system. 

The DSP32 has two full-duplex ports, one which is se- 
rial and the other parallel. The serial port is occupied by 
the speech codec. The parallel port can be connected to a 
microprocessor which can manage the 16 kb/s data- 
stream. Alternatively, dual-ported RAM could be used to 
transfer data between the channel and the coder. 

At the decoder the 16 kb/s data stream is input to the 
RCPC decoder in a soft decision format. Bit values are 
represented on a scale of — 1 .0 to +1.0, with those values 
representing full confidence in the bits. Bits which have 
less confidence have a smaller magnitude. Bits which have 
been punctured are represented by a 0. The entire soft 
decision bit stream is then processed with the Viterbi de- 
coder to determine the maximum likelihood path through 
the trellis. After processing all the RCPC protected bits 
in the frame, the state of the convolutional coder should 
be back to its original state, i.e., that formed by the four 
free bits we are using to “frame” the code. Thus, the path 


DSP32 

6.25 Mips 

1 2 kb/s Speech Coder 

3.66 Mips 

RCPC Encode/Decode 

2.34 Mips 


Fig. 11. Block diagram of the D-SBC and RCPC full-duplex on a single 
AT&T DSP-32. 

through the trellis leading to this state is chosen as the 
maximum likelihood path. Once the path has been cho- 
sen, the bit stream can be released and the D-SBC decoder 
can produce the output speech. 

VIII. Overall Performance 

The overall performance of the system has been eval- 
uated for different combinations of speech and channel 
coder rates. Some typical results are presented in Figs. 12 
and 13 and 14 for the sub-band coder with various error 
protection strategies and channel conditions. 

A Results with Unequal Error Protection for 12 kb/s 
Speech Coder 

Fig. 12 shows the segmental signal-to-noise ratio for 4 
different methods of transmitting 12 kb/s speech over the 
16 kb/s mobile channel. We have assumed that the 
threshold for acceptable quality is at about 2-3 dB deg- 
radation in SEGSNR compared to error free transmission. 
For reference, curve A shows the result for no error pro- 
tection. Curve B has “perfect rate 1/3 error protection” 
on the side information of the subband coder. The re- 
maining speech bits are transmitted unprotected resulting 
in a scheme with two levels of unequal error protection. 
This curve is clearly an upper bound on the performance 
with any real rate 1/3 code. Curve D gives the segmental 
signal-to-noise ratio for the case of a rate 3/4 convolu- 
tional code with 16 states applied uniformly to all speech 
bits in the frame. This corresponds to one level of equal 
error protection. Finally, curve C shows a system with 4 
levels of unequal error protection using the channel code 
in Table II. The same interleaving depth and decoder 
complexity is used for systems C and D. As we pointed 
out before, the bits in a block from the speech encoder 
have significantly different sensitivities to transmission 
errors. It can therefore be expected that improvements are 
obtained by carefully matching the error protection level 
to the source bits. A comparison of curves C and D clearly 
illustrates this. Informal listening tests convey the same 
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Fig. 12. Speech SEGSNR versus channel SNR for Rayleigh fading and 4 
different transmission formats. 


message. For system B, it turns out that there are too many 
unprotected bits. As we will see later, it is better to use a 
less powerful code on a larger number of speech bits and 
leave fewer bits unprotected. Thus, with the same number 
of code states (and thus roughly the same system com- 
plexity) and identical transmission channel bandwidth, the 
matched 4-level system C clearly outperforms the equal 
error protection system in curve D. 

Most of the discussions until now have centered around 
the problem of matching the source and channel code for 
the worst case Rayleigh fading channel. Implicitly, we 
have assumed that if the system can handle this case, it 
will also work for better transmission channels. This is 
illustrated in Fig. 13 which shows the performance of the 
same set of codes used in system C of Fig. 10 on a Rice 
channel with the Rice factor of 7 dB [5] . It is obvious that 
the performance on the Rice channel is much better. For 
an overall speech SEGSNR of 13 dB, under the Rice fad- 
ing conditions, the average channel SNR can be as low as 
9 dB. 

B . Adaptive Assignment of Speech and Channel Coding 
Rates 

In order to maximize the overall speech quality, it is 
necessary to adapt the speech and channel coding rates as 
a function of the channel condition. Under poor channel 
conditions, more bits should be spent on channel coding, 
which would reduce the quality of the speech coder (in- 
creased quantization noise), but would also reduce the 
distortion due to the channel (lower noise due to trans- 
mission errors), thus resulting in improved overall speech 
quality. Such an idea has been tried successfully with 
PCM (see [8], and further references therein) and 
ADPCM [23]. The embedded feature of the D-SBC and 
the flexibility of the RCPC channel coder makes this pos- 
sible here too. Fig. 14 shows one such result for the cur- 
rent scenario. Under good channel conditions, 12 kb/s is 
used for speech coding and 4 kb/s for channel coding. 
Under worse conditions, the speech coder rate drops to 10 
kb/s and the channel redundancy increases to 6 kb/s. We 
can thus see the considerable increase in the speech qual- 



Fig. 13. Comparison of the performance of the 4-level protection system 
on Rayleigh and Rice channels; 12 kb/s speech and 2 frame interleaving. 



Fig. 14. Illustration of adaptive rate assignment with 12 and 10 kb/s 
speech coders. 

ity over a variety of channel conditions with this adaptive 
rate assignment. We have also shown in this figure, the 
results of performing interleaving over only one frame in- 
stead of the usual two. We can notice the considerable 
degradation in performance. However, if delay is of pri- 
mary concern, then the figure shows that the speech coder 
rate should be dropped to 10 kb/s and that 6 kb/s of 
channel coding is a necessity . 

C. Delay Budget 

Fig. 15 shows the delay budget of the entire speech and 
channel coding system. The inherent delay (processor in- 
dependent) of the speech coding system is 24 ms, of which 
16 ms is due to the encoder/decoder buffers and 8 ms is 
due to the analysis/synthesis filter banks. The DSP-32 
processing delay is about 16 ms per speech frame, which 
is the total time required to perform speech encoding, 
channel encoding, channel decoding (Viterbi decoding) 
and speech decoding. The time to transmit a protected 
speech frame of 256 b is 16 ms for a 16 kb/s modem. 
The receiver can start processing the data only after all 
the bits are received. This adds an additional delay of 16 
ms. Thus, the total delay for a single frame interleaved 
speech and channel coding system is 56 ms. 
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bitstream 


output 

speech 


F = filterbank delay 
B = block size 
I = interleaving factor 

Fig. 15. Delay budget for the combined speech and channel coding 
system. 


If interleaving is performed over more than a frame, 
additional delay is incurred. For interleaving over two 
frames, the first frame suffers an additional delay of 16 
ms at the encoder as the second frame is being processed. 
Similarly, the second frame suffers a delay of 16 ms at 
the decoder as the first frame is being processed. In ad- 
dition, the receiver needs to wait for 32 ms (transmission 
time of two frames) before it can start processing the re- 
ceived data. Thus, there is a delay of 48 ms solely due to 
two frame interleaving. The total delay is 88 ms. In gen- 
eral for interleaving over I frames, the interleaving delay 
alone is (21 - 1) frames. 

IX. Discussion and Conclusions 
In this paper we have described a dynamic bit alloca- 
tion subband coder and a rate compatible punctured con- 
volutional channel coder. The subband coder produces 
good communications quality speech at bit rates as low as 
12 kb/s. The coder also produces a prioritized bit stream 
which easily can be exploited for noisy channels. An 
analysis of the bit error sensitivities revealed that not all 
of the bits in the bit stream require error protection, and 
among those that do, unequal error protection is called 
for. The RCPC channel coder is extremely flexible and 
capable of producing unequal error protection while using 
the same convolutional encoder and decoder for all bits. 
When matched to the speech coder bit stream, a combined 
16 kb/s coder was produced which was demonstrated to 
give robust performance over even fairly noisy channels. 
The technique which is used here, namely, to determine 
the error sensitivity of the subband coded bits and to match 
the channel coder according to the error sensitivity infor- 
mation, can be used with any other source coding scheme. 
Our main message in this paper is that there are large per- 
formance gains to be obtained in the system performance 
(with no increase in bandwidth and a small complexity 
increase) by carefully matching the source and channel 
coding. 


Appendix A 

Detailed Evaluation of the Effect of 
Transmission Errors 


P 

n 


U) 

(7) 


1 

2 N- 1 

Q j + 2 p e a ( e j) 

e = 1 


(A.l) 


where Q ij) is the quantization noise which is defined in 
(7), and d { e j) is the & factor corresponding to an error pat- 
tern e for block j. 

Equation (A. 1) is impractical to evaluate for large N ( N 
is more than 100 b for the subband coder). Instead, we 
consider approximations which analyze the effect of er- 
rors in terms of single and double error patterns. The 
probability of more than three errors (especially) after er- 
ror protection is assumed to be negligible. 

For independent, equiprobable bit errors with bit error 
probability P, the probability of a specific error pattern e 
with exactly w bit errors is 

P e = P"( 1 - Pf~ w . (A.2) 

This suggests that the contribution to the noise can be 
evaluated by grouping all the error patterns with the same 
weight, which has i. Indeed this has been done in [7]- 
[10]. Let us define the 3 factors through the relation 

2 N - 1 N 

2 p e a { = 2 p w z ( ». ' (A.3) 

e = 1 H' = 1 


Let the first N d factors (e = 1, * * * , N) correspond to 
single bit error patterns. Then 3 r -factor for the y'th seg- 
ment is given by 

N 

3 \ J) = 2 (A. 4) 

i = I 


and the 3 2 factor for the ;th segment is obtained as 

3^ = 2 - N3| y) (A. 5) 

e' 

where e' consists of all the ( 2 ) double error patterns. Sim- 
ilarly, the higher order 3 factors can be obtained from the 
lower order 3 factors [9] . 


1. Effect of Double Errors 

In the main text, the effect of single errors was studied 
in detail. However, in practice, even after channel error 
protection, more than one bit error can occur within a 
frame of speech, although with lower probability. To de- 
termine the effect of such errors, we consider the double 
bit error events with such error confined to one word. 
However, numerical results presented still assume that the 
bit errors are independent because of the inherent limita- 
tions in analyzing correlated errors. The segmental SNR 
based on the first two 3 factors is given by 


10 

SEGSNR = — 2 log 
J y=l 


1 

_Q U) + P 3 \ j> + P 2 3 ^_‘ 


(A. 6) 


From (6), we can define the signal-to-noise ratio for 
block j as 


Tables III and IV summarize the 3( and 3 2 factors for 
a few segments of speech. The errors are confined to the 
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TABLE III 

3-Factors for a Sample of Six Consecutive High 
Energy Segments of Speech 


Bits 

3. 

3 2 


9.66 

-44.32 


5.92 

-28.32 

Side Information 

5.43 

-19.11 

Bits 3-16 

4.82 

-19.68 


7.01 

-38.75 


4.39 

-14.64 


2.83 

0.88 


2.59 

0.71 

Main Information 

2.73 

0.67 

Bits 33-48 

2.63 

0.82 


2.75 

0.66 


2.96 

1.01 


1.02 x 10“ 2 

-3.17 X 10~ 5 


8.90 x 10' 3 

-2.52 x 10“ 5 

Main Information 

1.06 x 10~ 2 

1.57 x 10“ 4 

Bits 160-176 

8.24 x 10“ 3 

-8.90 x 10“ 4 


6.00 x 10' 3 

3.30 x 10“ 5 


1.22 x 10~ 3 

3.86 x 10~ 6 


TABLE IV 

3-Factors for a Sample of Six Consecutive Low 
Energy Segments of Speech 


Bits 

3, 

3 2 


1.37 x 10 4 

2.54 x 10 5 


8.86 x 10 3 

1.62 x 10 5 

Side Information 

1.00 x 10 4 

1.83 x 10 5 

Bits 3-16 

1.61 x 10 4 

2.97 x 10 s 


1.20 x 10 4 

2.26 x 10 5 


9.80 x 10 3 

1.61 x 10 5 


0.65 

6.57 x 10 2 


0.53 

2.92 x 10 2 

Main Information 

7.47 x 10 2 

1.64 x 10~ 2 

Bits 33-48 

0.44 

-6.73 X 10“ 2 


0.56 

-5.68 x 10“ 2 


0.56 

0.20 


3.38 x 10" 3 

1.88 x 10“ 2 


0.23 

-8.25 x 10“ 2 

Main Information 

0.25 

-5.18 x 10" 2 

Bits 160-176 

0.40 

-0.24 


0.28 

-3.85 x 10~ 2 


0.32 

0.15 


side information bits 3-16, the main information (bits 33- 
48) and (bits 170-192). The speech coder is the 12 kb/s 
coder. We first consider the high energy segments for 
which the results are in Table III. These segments have 
their average energy considerably above the average en- 
ergy of all the segments. Perhaps the most striking result 
is that the 3 2 factors are in fact negative! This result means 
that the segmental SNR results using only single bit errors 
is pessimistic when the effect of double errors is also taken 
into account (P 2 3[ J) is negative). We next consider the 16 
most significant main information bits (bits 33-48). For 
the same segments considered above, the 3 2 factors are 
smaller than the 3! factors resulting in negligible contri- 
bution to the noise power. The same effect is felt for the 
least significant bits. The effect of double errors is further 
mitigated by the fact that double errors are P times less 


probable than single errors (assuming independent er- 
rors), resulting in an average negligible noise power. 

We next consider low energy segments in Table IV. 
These segments have their energy considerably below the 
average energy value of all the segments. The results are 
quite different as compared to high energy segments. Both 
3j and 3 2 factors are considerably higher when there are 
errors in the side information. In fact 3 2 factors are con- 
siderably higher than 3, factors. This should be contrasted 
with the result for high energy segments where the 3 2 fac- 
tors are negative. The implication of this result is that 
double errors to the side information will be more notice- 
able during silent regions. Fortunately, the average noise 
power due to double errors is still small because of the 
less frequent occurrence (P 2 ) of these errors. The result 
also shows that the effect of errors in main information is 
negligible. 

The above numerical example, together with the inher- 
ent interleaving in the speech coder/decoder seems to in- 
dicate that the single error analysis is a reasonable first- 
order approximation. In principle, we can easily evaluate 
the effect of error patterns with multiple errors produced 
by a channel decoder. This is done by injecting the most 
likely decoded error patterns, and evaluating the corre- 
sponding (X factors. However, this has to be repeated for 
every single channel encoder and decoder combination. 
The approximate single bit error method is independent 
of the channel code specifics. 
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